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States Code, and that such willful false statements may jeopardize the validity of the application, 
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status upon receipt of a Notice of Missing Parts. 
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1 SPECIFICATION 

2 

3 To all whom it may concern: 

4 Be it known that Noah Syroid, a citizen of the United States of America, Dwayne 

5 Westenskow, a citizen of the United States of America, Julio C. Bermudez, a citizen of 

6 Argentina, and James Agutter, a citizen of the United States of America, have invented a 

7 new and useful invention entitled "METHOD AND APPARATUS FOR MONITORING 

8 ANESTHESIA DRUG DOSAGES, CONCENTRATIONS, AND EFFECTS USING N- 

9 DIMENSIONAL REPRESENTATIONS OF CRITICAL FUNCTIONS" of which the 
5 10 following comprises a complete specification. 

m 1 1 This patent application is a continuation-in-part patent application of U.S. Patent 

rU 12 Application Serial Number 09/457,068, which was filed on December 7, 1999, and which 

^ 13 is presently pending before the United States Patent and Trademark Office. Priority is 

% 14 hereby claimed to all material disclosed in this pending parent case. 

15 
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1 METHOD AND APPARATUS FOR MONITORING ANESTHESIA 

2 DRUG DOSAGES, CONCENTRATIONS AND EFFECTS USING N- 

3 DIMENSIONAL REPRESENTATIONS OF CRITICAL FUNCTIONS 

4 

5 Background of the Invention 

6 Field of the Invention. This invention relates to the visuaUzation, perception, 

7 representation and computation of data relating to the attributes or conditions constituting 

8 the health state of a dynamic system. More specifically, this invention relates to the 

9 display and computation of anesthesia drug data, in which variables constituting 

10 attributes and conditions of a dynamic anesthesia system can be interrelated and visually 

1 1 correlated in time as three-dimensional objects. 

12 Description of the Related Art, A variety of methods and systems for the visualization 

13 of data have been proposed. Traditionally, these methods and systems fail to present in a 

14 real-time multi-dimensional format that is directed to facilitating a user's analysis of 

15 multiple variables and the relationships between such multiple variables. Moreover, such 

16 prior methods and systems, tend not to be specifically directed to the monitoring of 

17 anesthesia or which is capable of estimating, predicting and displaying drug dosages, 

18 drug concentrations, and drug effects during anesthesia. Prior methods typically do not 

19 process and display data in real-time, rather they use databases or spatial organizations of 

20 historical data. Generally, they also simply plot existing information in two or three 

21 dimensions, but without using three-dimensional geometric objects to show the 

22 interrelations between data. Often previous systems and methods are limited to pie 

23 charts, lines or bars to represent the data. Also, many previous systems are limited to 

2 



1 particular applications or types of data. The flexibility and adaptability of the user 

2 interface and control is typically very limited, and may not provide flexible coordinate 

3 systems and historical-trend monitors. Other systems, which have a flexible user 

4 interface, generally require substantial user expertise in order to collect and evaluate the 

5 data, including the pre-identification of data ranges and resolution. Another common 

6 limitation of previous systems and methods is that they provide only a single or 

7 predetermined viewpoint from which to observe the data. Typically, prior systems and 

8 methods do not provide data normalcy frameworks to aid in the interpretation of the data. 

9 Furthermore, most prior methods use "icons," shapes, lines, bars, or graphs. For general 

10 background material, the reader is directed to United States Patent Nos. 4,671,953, 

11 4,752,893, 4,772,882, 4,813,013, 4,814,755, 4,823,283, 4,885,173, 4,915,757, 4,926,868, 

12 5,021,976, 5,121,469, 5,262,944, 5,317,321, 5,484,602, 5,485,850, 5,491,779, 5,588,104, 

13 5,592,195, 5,596,694, 5,651,775, 5,680,590, 5,751,931, 5,768,552, 5,774,878, 5,796,398, 

14 5,812,134, 5,830,150, 5,873,731, 5,875,108, 5,901,246, 5,923,330, 5,925,014 5,957,860, 

15 and 6,042,548 each of which is hereby incorporated by reference in its entirety for the 

16 material disclosed therein. 

17 As this disclosure employs a number of terms, which may be new to the reader, 

18 the reader is directed to the applicants' definitions section, which is provided at the 

19 beginning of the detailed description section. 

20 Summary of the Invention 

21 It is desirable to provide a method, system, and apparatus, which facilitates the 

22 rapid and accurate analysis of complex and quickly changing anesthesia drug data. 

23 Moreover, it is desirable that such a system and method be capable of estimating. 



3 



1 predicting and displaying drug dosages, drug concentrations and drug effects during 

2 anesthesia. It is desirable that such a system and method be capable of analyzing time 

3 based, real-time, and historical data and that it be able to graphically show the 

4 relationships between various data. 

5 Research studies have indicated that the human mind is better able to analyze and 

6 use complex data when it is presented in a graphic, real world type representation, rather 

7 than when it is presented in textual or numeric formats. Research in thinking, 

8 imagination and learning has shown that visualization plays an intuitive and essential role 

9 in assisting a user associate, correlate, manipulate and use information. The more 

10 complex the relationship between information, the more critically important is the 

1 1 communication, including audio and visualization of the data. Modem human factors 

12 theory suggests that effective data representation requires the presentation of information 

13 in a manner that is consistent with the perceptual, cognitive, and response-based mental 

14 representations of the user. For example, the application of perceptual grouping (using 

15 color, similarity, connectedness, motion, sound etc.) can facilitate the presentation of 

16 information that should be grouped together. Conversely, a failure to use perceptual 

17 principles in the appropriate ways can lead to erroneous analysis of information. 

18 The manner in which information is presented also affects the speed and accuracy 

19 of higher-level cognitive operations. For example, research on the "symbolic distance 

20 effect" suggests that there is a relationship between the nature of the cognitive decisions 

21 (for example, is the data increasing or decreasing in magnitude?) and the way the 

22 information is presented (for example, do the critical indices become larger or smaller, or 

23 does the sound volume or pitch rise or fall?). Additionally, "population stereotypes" 
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1 suggest that there are ways to present information that are compatible with well-learned 

2 interactions with other systems (for example, an upwards movement indicates an 

3 increasing value, while a downwards movement indicates a decreasing value). 

4 Where there is compatibility between the information presented to the user and 



5 the cognitive representations presented to the user, performance is often more rapid, 

6 accurate, and consistent. Therefore, it is desirable that information be presented to the 

7 user in a manner that improves the user's ability to process the information and 



8 minimizes any mental transformations that must be applied to the data. 

9 Therefore, it is the general object of this invention to provide a method and 

10 systems for presenting a three-dimensional visual and/or possibly an audio display 

1 1 technique that assists in the monitoring and evaluation of drug data. 

12 It is a further object of this invention to provide a method and system that assists 

13 in the evaluation of drug data with respect to the classification of an anesthetic. 

14 It is another object of this invention to provide a method and system that assists in 

15 the evaluation of drug data with respect to anesthetics, including sedatives, analgesics, 

16 and muscle relaxants. 

17 It is a still further object of this invention to provide a method and system that 

18 assists in the display of drug effects during anesthesia that takes into account the patient's 

19 age, gender, height and weight as related to historical or normative values. 

20 Another object of this invention is to provide a method and system that assists in 

21 the evaluation of drug effects during anesthesia that provides for system execution faster 

22 than real time. 
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1 A still further object of this invention is to provide a method and system, which 

2 provides the gathering and use of sensor measured data, as well as the formatting and 

3 normalization of the data in a format suitable to the processing methodology, 

4 A further object of this invention is to provide a method and system, which can 

5 normalize drug concentration and can display the concentration relative to the time that it 

6 was administered. 

7 Another object of this invention is to provide a method and system, which 

8 provides a three-dimensional graphic display for the use of doctors in an operating room. 

9 It is another object of this invention to provide a method and system, which 

10 provides three-dimensional graphic display that is used in conjunction with automatic 

1 1 drug delivery systems. 

12 It is an object of this invention to provide a method and system that provides a 

13 visual display record of the drugs administered and a current, past and predicted estimate 

14 of how the drug should be expected to affect the patient. 

15 It is a further object of this invention to provide a method and system that permits 

16 an integrated and overall holistic understanding of the effects of drugs during anesthesia. 

17 A further object of this invention is to provide a method and system where three- 

18 dimensional objects are built from three-dimensional object primitives, including: cubes, 

19 spheres, pyramids, n-polygon prisms, cylinders, slabs. 

20 A still further object of this invention is to provide a method and system, wherein 

21 three-dimensional objects are placed within health-space based on the coordinates of their 

22 geometric centers, edges, vertices, or other definite geometric variables. 
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1 It is a further object of this invention to provide a method and system, v^hich has 

2 three-dimensional objects that have three spatial dimensions, as well as geometric, 

3 aesthetic and aural attributes, to permit the mapping of multiple data functions. 

4 It is another object of this invention to provide a method and system, which shows 

5 increases and decreases in data values using changes in location, size, form, texture, 

6 opacity, color, sound and the relationships thereof in their context, 

7 It is a still further object of this invention to provide a method and system, 

8 wherein the particular three-dimensional configuration of three-dimensional objects can 

9 be associated with a particular time and health state. 

10 A still further object of this invention is to provide a method and system that 

11 permits the simultaneous display of the history of data objects. 

12 Another object of this invention is to provide a method and system that provides 

13 for the selection of various user selectable viewports. 

14 It is a further object of this invention to provide a method and system that 

15 provides both a global and a local three-dimensional coordinate space. 

16 It is another object of this invention to provide a method and system that permits 

17 the use of time as one of the coordinates. 

18 It is a still further object of this invention to provide a method and system that 

19 provides a reference framework of normative values for direct comparison with the 

20 measured data. 

21 It is a further object of this invention to provide a method and system where 

22 normative values are based on the average historical behavior of a wide population of 

23 healthy systems similar to the system whose health is being monitored. 
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1 A further object of this invention is to provide a method and system that provides 

2 viewpoints that can be selected to be perspective views, immersive Virtual Reality views, 

3 or any orthographic views. 

4 Another object of this invention is to provide a method and system that permits 

5 the display of a layout of multiple time-space viewpoints. 

6 A still further object of this invention is to provide a method and system that 

7 provides for zooming in and out of a time and/or space coordinate. 

8 It is another object of this invention to provide a method and system that permits 

9 temporal and three-dimensional modeling of data "health" states based on either pre- 

10 recorded data or real-time data, that is as the data is obtained, 

1 1 Another object of this invention is to provide a method and system that presents 

12 the data in familiar shapes, colors, and locations to enhance the usability of the data. 

13 A still further object of the invention is to provide a method and system that uses 

14 animation, and sound to enhance the usefulness of the data to the user. 

15 It is an object of this invention to provide a method and system for the 



16 measurement, computation, display and user interaction, of complex data sets that can be 

17 communicated and processed at various locations physically remote from each other, 

18 over a communication network, as necessary for the efficient utilization of the data and 

19 which can be dynamically changed or relocated as necessary. 

20 It is a still further object of this invention to provide a method and system for the 

21 display of data that provides both a standard and a customized interface mode, thereby 

22 providing user and application flexibility. 
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1 These and other objects of this invention are achieved by the method and system 

2 herein described and are readily apparent to those of ordinary skill in the art upon careful 

3 review of the following drawings, detailed description and claims. 

4 Brief Description of the Drawings 

5 In order to show the manner that the above recited and other advantages and 



6 objects of the invention are obtained, a more particular description of the preferred 

7 embodiment of the invention, which is illustrated in the appended drawings, is described 

8 as follows. The reader should understand that the drawings depict only a preferred 

9 embodiment of the invention, and are not to be considered as limiting in scope. A brief 

10 description of the drawings is as follows: 



1 1 Figure la is a top-level representative diagram showing the data processing paths 

12 of the preferred embodiment of this invention. 

13 Figure lb is a top-level block diagram of the data processing flow of the preferred 

14 embodiment of this invention. 

15 Figure Ic is a top-level block diagram of one preferred processing path of this 

16 invention. 

17 Figure Id is a top-level block diagram of a second preferred processing path of 

18 this invention. 

19 Figures 2a, 2b, 2c, and 2d are representative 3-D objects representing critical 

20 functions. 

21 Figure 3 is a representation of data objects in H-space. 

22 Figures 4a and 4b are representative views of changes in data objects in time. 
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1 Figures 5a, 5b, 5c, 5d, 5e, 5f, 5g and 5h are representative views of properties of 

2 data objects provided in the preferred embodiment of this invention. 

3 Figure 6 shows a 3-D configuration of the objects in H-space in the preferred 

4 embodiment of the invention. 

5 Figure 7 shows H-space with a time coordinate along with local-space 

6 coordinates. 

7 Figures 8a and 8b show the global level coordinate system of the preferred 

8 embodiment of this invention. 

9 Figures 9a and 9b show various viewpoints of the data within H-space in the 

10 preferred embodiment of this invention. 

1 1 Figure 10 shows the transformation of an object in space in context, with a 

12 reference framework, in the preferred embodiment of this invention. 

13 Figure 11a shows the zooming out function in the invention. 

14 Figure 1 lb shows the zooming in function in the invention. 

15 Figures 12a and 12b show a 3-D referential framework of normative values. 

16 Figure 13 shows the interface modes of the preferred embodiment of this 

17 invention. 

18 Figure 14 is a hardware system flow diagram showing various hardware 

19 components of the preferred embodiments of the invention. 

20 Figure 15 is a software flow chart showing the logic steps of a preferred 

21 embodiment of the invention. 

22 Figure 16 is a software block diagram showing the logic steps of the image 

23 computation and rendering process of a preferred embodiment of the invention. 
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1 Figure 17 is a photograph of the 3-dimensional display of a preferred embodiment 

2 of the invention. 

3 Figure 18 is a close-up front view of the cardiac object and the associated 

4 reference grid of a preferred embodiment of the invention. 

5 Figure 19 is a view of the front view portion of the display of a preferred 

6 embodiment of the present invention showing the cardiac object in the foreground and 

7 the respiratory object in the background. 

8 Figure 20 is a view of the top view portion of the display of a preferred 

9 embodiment of the present invention showing the cardiac object toward the bottom of the 

10 view and the respiratory object toward the top of the view. 

1 1 Figure 21 is a view of the side view portion of the display of a preferred 

12 embodiment of the present invention showing the cardiac object to the left and the 

13 respiratory object to the right. 

14 Figure 22 is a view of the 3-D perspective view portion of the display of a 

15 preferred embodiment of the invention showing the cardiac object in the left foreground 

16 and the respiratory object in the right background. 

17 Figure 23 is a view of an example of the preferred display of the drug effects 

18 shown in this invention. 

19 Figure 24 is a view of a second example of the preferred display of the drug 

20 effects shown in this invention. 

21 Figure 25 is a system flow process flow diagram of the preferred embodiment of 

22 this invention. 
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1 Figure 26 is a preferred hardware/communication diagram of the preferred 

2 embodiment of this invention. 

3 Figure 27 is a top-level flow chart of the preferred drug monitoring process of this 

4 invention. 

5 Figure 28 is a detailed flow chart of the initialize variables section of the preferred 

6 drug monitoring process of this invention. 

7 Figure 29 is a detailed flow chart of the run drug display section of the preferred 

8 drug monitoring process of this invention. 

9 Figure 30 is a detailed flow chart of the run demo mode section of the preferred 

10 drug monitoring process of this invention. 

1 1 Figure 3 1 is a detailed flow chart of the idle loop section of the preferred drug 

12 monitoring process of this invention. 

13 Figure 32 is a detailed flow chart of the render the scene section of the preferred 

14 drug monitoring process of this invention. 

15 Figure 33 is a detailed flow chart of the iterate drug model section of the preferred 

16 drug monitoring process of this invention. 

17 Figure 34 is a detailed flow chart of the shift data left section of the preferred drug 

18 monitoring process of this invention. 

19 Figure 35 is a detailed flow chart of the decode data packet section of the 

20 preferred drug monitoring process of this invention. 

21 Figure 36 is a detailed flow chart of the draw plot section of the preferred drug 

22 monitoring process of this invention. 
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1 Figure 37 is a detailed flow chart of the timer interrupt routine section of the 

2 preferred drug monitoring process of this invention. 

3 Reference is now made in detail to the present preferred embodiments of the 

4 invention, examples of which are illustrated in the accompanying drawings. 

5 Detailed Description of the Invention 

6 This invention is a method, system and apparatus for the visual display of 

7 complex sets of dynamic data. In particular, this invention provides the means for 

8 efficiently analyzing, comparing and contrasting data, originating from either natural or 

9 artificial systems. This invention provides n-dimensional visual representations of data 

10 through innovative use of orthogonal views, form, space, frameworks, color, shading, 

1 1 texture, transparency, sound and visual positioning of the data. The preferred system of 

12 this invention includes one or a plurality of networked computer processing and display 

13 systems, which provide real-time as well as historical data, and which processes and 

14 formats the data into an audio-visual format with a visual combination of objects and 

15 models with which the user can interact to enhance the usefulness of the processed data. 

16 While this invention is applicable to a wide variety of data analysis applications, one 

17 important application is the analysis of health data. For this reason, the example of a 

18 medical application for this invention is used throughout this description. The use of this 

19 example is not intended to limit the scope of this invention to medical data analysis 

20 applications only, rather it is provided to give a context to the wide range of potential 

21 application for this invention. 
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1 This invention requires its own lexicon. For the purposes of this patent 

2 description and claims, the inventors intend that the following terms be understood to 

3 have the following definitions. 

4 An "artificial system" is an entity, process, combination of human designed parts, 



5 and/or environment that is created, designed or constructed by human intention. 

6 Examples of artificial systems include manmade real or virtual processes, computer 

7 systems, electrical power systems, utility and construction systems, chemical processes 

8 and designed combinations, economic processes (including, financial transactions), 

9 agricultural processes, machines, and human designed organic entities. 



10 A "natural system" is a functioning entity whose origin, processes and structures 

11 were not manmade or artificially created. Examples of natural systems are living 

12 organisms, ecological systems and various Earth environments. 

13 The "health" of a system is the state of being of the system as defined by its 



14 freedom from disease, ailment, failure or inefficiency. A diseased or ill state is a 

15 detrimental departure from normal functional conditions, as defined by the nature or 

16 specifications of the particular system (using historical and normative statistical values). 

17 The health of a functioning system refers to the soundness, wholeness, efficiency or well 

18 being of the entity. Moreover, the health of a system is determined by its functioning. 



19 "Functions" are behaviors or operations that an entity performs. Functional 

20 fitness is measures by the interaction among a set of "vital-signs" normally taken or 

21 measured using methods well known in the art, from a system to establish the system's 

22 health state, typically at regular or defined time intervals. 



1 "Health-space" or "H-space" is the data representation environment that is used to 

2 map the data in three or more dimensions. 

3 "H-state" is a particular 3-D configuration or composition that the various 3-D 

4 objects take in H-space at a particular time. In other words, H-state is a 3-D snapshot of 

5 the system' s health at one point of time. 

6 "Life-space" or "L-space" provides the present and past health states of a system 

7 in a historical and comparative view of the evolution of the system in time. This 3-D 

8 representation environment constitutes the historical or Life-space of a dynamic system. 

9 L-space allows for both continuous and categorical displays of temporal dependent 

10 complex data. In other words, L-space represents the health history or trajectory of the 

11 system in time. 

12 ^'Real-Time Representation" is the display of a representation of the data within a 

13 fraction of a second from the time when the event of the measured data occurred in the 

14 dynamic system. 

15 "Real-Time User Interface" is the seemingly instantaneous response in the 

16 representation due to user interactivity (such as rotation and zooming). 

17 A "variable" is a time dependent information unit (one unit per time increment) 

1 8 related to sensing a given and constant feature of the dynamic system. 

19 "Vital signs" are key indicators that measure the system's critical functions or 

20 physiology. 

21 In the preferred embodiments of this invention, data is gathered using methods or 

22 processes well known in the art or as appropriate and necessary. For example, in general, 

23 physiologic data, such as heart rate, respiration rate and volume, blood pressure, and the 
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1 like, is collected using the various sensors that measure the functions of the natural 

2 system. Sensor-measured data is electronically transferred and translated into a digital 

3 data format to permit use by the invention. This invention uses the received measured 

4 data to deliver real-time and/or historical representations of the data and/or recorded data 

5 for later replay. Moreover, this invention permits the monitoring of the health of a 

6 dynamic system in a distributed environment. By distributed environment, it is meant 

7 that a user or users interacting with the monitoring system may be in separate locations 

8 from the location of the dynamic system being monitored. In its most basic elements, the 

9 monitoring system of this invention has three major logical components: (1) the sensors 

10 that measure the data of the system; (2) the networked computational information 

1 1 systems that computes the representation and that exchanges data with the sensors and 

12 the user interface; and (3) the interactive user interface that displays the desired 

13 representation and that interactively accepts the users' inputs. The components and 

14 devices that perform the three major functions of this invention may be multiple, may be 

15 in the same or different physical locations, and/or may be assigned to a specific process 

16 or shared by multiple processes. 

17 Figure la is a top-level representative diagram showing the data processing paths 

18 of the preferred embodiment of this invention operating on a natural system. The natural 

19 system 101a is shown as a dynamic entity whose origin, processes and structures 

20 (although not necessarily its maintenance) were not manmade or artificially created. 

21 Examples of natural systems are living organisms, ecological systems, and various Earth 

22 environments. In one preferred embodiment of the invention, a human being is the 

23 natural system whose physiology is being monitored. Attached to the natural system 
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1 101a are a number of sensors 102. These sensors 102 collect the physiologic data, 

2 thereby measuring the selected critical functions of the natural system. Typically, the 

3 data gathering of the sensors 102 is accomplished with methods or techniques well 

4 known in the art. The sensors 102 are typically and preferably electrically connected to a 

5 digital data formatter 103. However, in other embodiments of this invention, the sensors 

6 may be connected using alternative means including but not limited to optical, RF and the 

7 like. In many instances, this digital data formatter 103 is a high-speed analog to digital 

8 converter. Also, connected to the digital data formatter 103 is the simulator 101b. The 

9 simulator 101b is an apparatus or process designed to simulate the physiologic process 

10 underlying the life of the natural system 101a. A simulator 101b is provided to generate 

1 1 vital sign data in place of a natural system 101a, for such purposes as education, research, 

12 system test, and calibration. The output of the digital data formatter 103 is Real-Time 

13 data 104. Real-Time data 104 may vary based on the natural system 101a being 

14 monitored or the simulator 101b being used and can be selected to follow any desired 

15 time frame, for example time frames ranging from one-second periodic intervals, for the 

16 refreshment rates of patients in surgery, to monthly statistics reporting in an ecological 

17 system. The Real-Time data 104 is provided to a data recorder 105, which provides the 

18 means for recording data for later review and analysis, and to a data modeling processor 

19 and process 108. In the preferred embodiments of this invention the data recorder 105 

20 uses processor controlled digital memory, and the data modeling processor and process 

21 108 is one or more digital computer devices, each having a processor, memory, display, 

22 input and output devices and a network connection. The data recorder 105 provides the 

23 recorded data to a speed controller 106, which permits the user to speed-up or slow- 



17 



1 down, the replay of recorded information. Scalar manipulations of the time (speed) in 

2 the context of the 3-D modeling of the dynamic recorded digital data allows for new and 

3 improved methods or reviewing the health of the systems 101 a,b. A customize / 

4 standardize function 107 is provided to permit the data modeling to be constructed and 

5 viewed in a wide variety of ways according to the user's needs or intentions. 

6 Customization 107 includes the ability to modify spatial scale, such modifying includes 

7 but is not limited to zooming, translating, and rotating, attributes and viewports in 

8 addition to speed. In one preferred embodiment of the invention, the range of 

9 customization 107 permitted for monitoring natural systems 101a physiologic states is 

10 reduced and is heavily standardized in order to ensure that data is presented in a common 

1 1 format that leads to common interpretations among a diverse set of users. The data 

12 modeling processor and process 108 uses the prescribed design parameters, the 

13 standardized/customize function and the received data to build a three-dimensional (3-D) 

14 model in real-time and to deliver it to an attached display. The attached display of the 

15 data modeling processor and process 108 presents a representation 109 of 3-D objects in 

16 3-D space in time to provide the visual representation of the health of the natural system 

17 101a in time, or as in the described instances of the simulated 101b system. 

18 Figure lb is a top-level block diagram of the data processing flow of the 

19 preferred embodiment of this invention operating on an artificial system. An artificial 

20 system is a dynamic entity whose origin, processes and structure have been designed and 

21 constructed by human intention. Examples of artificial systems are manmade real or 

22 virtual, mechanical, electrical, chemical and/or organic entities. The artificial system 

23 1 10a is shown attached to a number of sensors 111. These sensors 1 1 1 collect the 
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1 various desired data, thereby measuring the selected critical functions of the artificial 

2 system. Typically, the data gathering of the sensors 111 is accomplished with methods or 

3 techniques well known in the art. The sensors 1 11 are connected to a data formatter 1 12, 

4 although alternative connection means including optical, RF and the like may be 

5 substituted without departing from the concept of this invention. In many instances, this 

6 digital data formatter 1 12 is a high-speed analog to digital converter. Although, in certain 

7 applications of the invention, namely stock market transactions, the data is communicated 

8 initially by people making trades. Also connected to the digital data formatter 1 12 is the 

9 simulator 1 10b. The simulator 1 10b is an apparatus or process designed to simulate the 

10 process underlying the state of the artificial system 1 10a. The simulator 1 10b is provided 

1 1 to generate vital data in place of the artificial system 1 10a, for such purposes as 

12 education, research, system test, and calibration. The output of the digital data formatter 

13 1 12 is Real-Time data 113. Real-Time data 113 may vary based on the artificial system 

14 1 10a being monitored or the simulator 1 10b being used and can be selected to follow any 

15 desired time frame, for example time frames ranging from microsecond periodic 

16 intervals, for the analysis of electronic systems, to daily statistics reported in an financial 

17 trading system. The Real-Time data 1 13 is provided to a data recorder 114, which 

18 provides the means for recording data for later review and analysis, and to a data 

19 modeling processor and process 117. In the preferred embodiments of this invention the 

20 data recorder 1 14 uses processor controlled digital memory, and the data modeling 

21 processor and process 117 is one or more digital computer devices, each having a 

22 processor, memory, display, input and output devices and a network connection. The 

23 data recorder 1 14 provides the recorded data to a speed controller 115, which permits the 
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1 user to speed-up or slow-down, the replay of recorded information. Scalar 

2 manipulations of the time (speed) in the context of the 3-D modeling of the dynamic 

3 recorded digital data allows for new and improved methods or reviewing the health of the 

4 system 1 10a,b. A customize / standardize function 1 16 is provided to permit the data 

5 modeling to be constructed and viewed in a wide variety of ways according to the user's 

6 needs or intentions. Customization 1 16 includes the ability to modify spatial scale (such 

7 modification including, but not limited to translating, rotating, and zooming), attributes, 

8 other structural and symbolic parameters, and viewports in addition to speed. The range 

9 of customization form monitoring artificial systems' 1 10a,b states is wide and not as 

10 standardized as that used in the preferred embodiment of the natural system 101 a,b 

1 1 monitoring, hi this Free Customization, the symbolic system and display method is fully 

12 adaptable to the user's needs and interests. Although this invention has a default 

13 visualization space, its rules, parameters, structure, time intervals, and overall design are 

14 completely customizable. This interface mode customize/standardize function 116 also 

15 allows the user to select what information to view and how to display the data. This 

16 interface mode customization 116 may, in some preferred embodiments, produce 

17 personalized displays that although they may be incomprehensible to other users, 

18 facilitate highly individual or competitive pursuits not limited to standardized 

19 interpretations, and therefore permit a user to look at data in a new manner. Such 

20 applications as analysis of stock market data or corporation health monitoring may be 

21 well suited to the flexibility of this interface mode. The data modeling processor and 

22 process 1 17 uses the prescribed design parameters, the customize/standardized function 

23 116 and the received real-time data 1 13 to build a three-dimensional (3-D) model in time 
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1 and to deliver it to a display. The display of the data modeling processor and process 

2 117 presents a representation 1 18 of 3-D objects in 3-D space in time to provide the 

3 visual representation of the health of the artificial system 1 10a in time, or as in the 

4 described instances of the simulated 1 10b system. 

5 Figure Ic is a top-level block diagram of one preferred processing path of this 

6 invention. Sensors 1 19 collect the desired signals and transfer them as electrical impulses 

7 to the appropriate data creation apparatus 120. The data creation apparatus 120 converts 

8 the received electrical impulses into digital data. A data formatter 121 receives the 

9 digital data from the data creation apparatus 120 to provide appropriate formatted data for 

10 the data recorder 122. The data recorder 122 provides digital storage of data for 

1 1 processing and display. A data processor 123 receives the output from the data recorder 

12 122. The data processor 123 includes a data organizer 124 for formatting the received 

13 data for further processing. The data modeler 125 receives the data from the data 

14 organizer and prepares the models for representing to the user. The computed models are 

15 received by the data representer 126, which formats the models for presentation on a 

16 computer display device. Receiving the formatted data from the data processor 123 is a 

17 number of data communication devices 127, 130. These devices 127, 130 include a 

18 central processing unit, which controls the image provided to one or more local displays 

19 128, 131. The local displays may be interfaced with a custom interface module 129 

20 which provides user control of such attributes as speed 131, object attributes 132, 

21 viewports 133, zoom 134 and other like user controls 135. 

22 Figure Id is a top-level block diagram of a second preferred processing path of 

23 this invention. In this embodiment of the invention a plurality of entities 136a,b,c are 
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1 attached to sensors 137a,b,c which communicate sensor data to a data collection 

2 mechanism 138, which receives and organizes the sensed data. The data collection 

3 mechanism 138 is connected 139 to the data normalize and formatting process 140, The 

4 data normalize and formatting process 140 passes the normalized and formatted data 141 

5 to the distributed processors 142. Typically and preferably the processing 142 is 

6 distributed over the Internet, although alternative communication networks may be 

7 substituted without departing from the concept of this invention. Each processing unit 

8 142 is connected to any of the display devices 143a,b,c and receives command control 

9 from a user from a number of interface units 144a,b,c, each of which may also be 

10 connected directly to a display devices 143a,b,c, The interface units 144a,b,c receive 

1 1 commands 145 from the user that provide speed, zoom and other visual attributes 

12 controls to the displays 143a,b,c. 

13 Figures 2a, 2b, 2c, and 2d are representative 3-D objects representing critical 

14 functions. Each 3-D object is provided as a symbol for a critical function of the entity 

15 whose health is being monitored. The symbol is created by selecting the interdependent 

16 variables that measure a particular physiologic function and expressing the variable in 

17 spatial (x,y,z) and other dimensions. Each 3-D object is built from 3-D object primitives 

18 (i.e., a cube, a sphere, a pyramid, a n-polygon prism, a cylinder, a slab, etc.). More 

19 specifically, the spatial dimensions (extensions X, Y and Z) are modeled after the most 

20 important physiologic variables based on (1) data interdependency relationships, (2) rate, 

21 type and magnitude of change in data flow, (3) geometric nature and perceptual potential 

22 of the 3-D object, for example a pyramid versus a cylinder, (4) potential of the object's 

23 volume to be a data-variable itself by modeling appropriate data into x, y and z 
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1 dimensions (e.g., in one preferred application of the invention, cardiac output is the result 

2 of heart rate (x and y dimensions) and stroke volume (z)), (5) orthographic viewing 

3 potential (see viewport) and (6) the relationship with the normal values framework. 

4 The first representative object 201, shown in figure 2a, is an engine process. The 

5 object 201 representing this process is provided on a standard x-y-z coordinate axis 202. 

6 The correlation between temperature, shown in the xl -dimension 204, engine RPM, 

7 shown in the yl -dimension 205 and exhaust gas volume, shown in the zl -dimension 203 

8 is shown by changes in the overall sizes and proportion of the object 201 . In the shown 

9 example object 201 the engine gas volume 203 is large, when RPM 205 is low and the 

10 engine temperature 204 is in the middle range. This combination of values, even without 

1 1 specific identified values suggests an engine's starting point. 

12 The second representative object 206, shown in figure 2b, is an object 

13 representing cardiac function using stroke volume, in the y2-dimension 209, and the heart 

14 rate per second, shown as the x2, z2 dimensions. The total cardiac volume is shown as 

15 the total spherical volume 208. 

16 The third representative object 211, shown in figure 2c, represents the interaction 

17 between the number of contracts, shown in the y3-dimension 212, the average revenue 

18 per contract, shown in the z3-dimension 214, and the average time per contract, shown in 

19 the x3 -dimension 213. Assessing the interaction among these variables is important in 

20 monitoring of a sales department's operations. 

21 The fourth representative object 215 is shown in figure 2d, shows the respiratory 

22 function generated by the respiratory rate, shown in x4-dimension 216, the respiratory 



1 volume, shown in the y4"dimension 216, and inhalation / exhalations, shown in the z4- 

2 dimension 218. 

3 Figure 3 is a representation of data objects in H-space 301. Data sets are 

4 represented as 3-D objects of various characteristics and relationships within a 3-D 

5 representation space. The data representation environment in this figure is used to map 

6 the physiologic data in 3-D and is what is referred to as "Health-space" or "H-space" 301. 

7 The 3-D objects are placed within H-space on the 3 coordinates of their geometric 

8 centers. The coordinates for an object's geometric center depends on the relevant data 

9 associated to the particular critical function the object represents. For example, in the 

10 preferred embodiment, the cardiac function object, shown as a spherical object 302, is 

1 1 placed in H-space 301 based on Mean Blood Pressure, designated as Oy 306 and Oxygen 

12 Saturation in the Blood, shown as Oz 307. In the other example object, the prism 309 is 

13 placed in H-space 301 depending on sales profit, shown as Py 312, and products in stock, 

14 shown as Pz, 3 1 1 . The location of 3-D objects in H-space 301 allows for the overall 

15 extension envelope of H-space, the relationship between 3-D objects and spaces within 

16 H-space 301 , the viewport display areas and the departure from normative values. 

17 Typically and preferably the centers of the objects 302, 309 are located in the middle of 

18 the x-dimension of H-space 301. 

19 Figures 4a and 4b are representative views of changes in data objects in time, hi 

20 figure 4a, the x-coordinate 400 is used to measure the temporal dimension of an objects 

21 402 trajectory. The y-z plane 401a determines the location of an object's geometric 

22 center within H-space. Licreases or decreases in data values associated with the 

23 coordinates of the object's geometric center that make that object's location change in 
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1 time as shown in path line 401b. In this view, the object 402 is presented in four different 

2 time intervals 403, 404, 405, 406, thereby creating a historical trajectory. The time 

3 intervals at which the object 402 is shown are provided 407. In figure 4b, increases in 

4 size and proportion are presented, 408, 409, 410, 41 1 providing an example of changes in 

5 values. The monitoring of these changes in time assists the user establish and evaluate 

6 comparative relationships within and across H- states. 

7 Figures 5a, 5b, 5c, 5d, 5e, 5f, 5g and 5h are representative views of properties of 

8 data objects provided in the preferred embodiment of this invention. In addition to the 

9 three x-y-z spatial dimensions used for value correlation and analysis, 3-D objects may 

10 present data value states by using other geometric, aesthetic, and aural attributes that 

11 provide for the mapping of more physiologic data. These figures show some of the 

12 representative other geometric, aesthetic, and aural attributes supported for data 

13 presentation in this invention. Figure 5a shows changes in apparent volumetric density. 

14 A solid object 501 is shown in relation to a void object 502 and an intermediate state 503 

15 object. Figure 5b shows changes in apparent 3-D enclosure. An open object 504, a 

16 closed object 505, and an intermediate state 506 is shown. Figure 5c shows the apparent 

17 degree of formal deformation. A normal object 507, a distorted object 508, a transformed 

18 object 509, and a destroyed object 510 are shown in comparison. Figure 5d shows 

19 secondary forms of the objects. "Needles" 513 protruding through a standard object 512 

20 in combination 51 1 is shown in comparison with a boundary 515 surrounding a standard 

21 object 514 and a bar 517 protruding into the original form object 518 forming a new 

22 combination object 516 are shown providing additional combination supported in this 

23 invention. Figure 5e shows the various degrees of opacity of the object's surface, 
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1 showing an opaque object 519, a transparent object 520 and an intermediate state object 

2 521 . Figure 5f shows the various degrees of texture supported by the object display of 

3 this invention, including a textured object 522, a smooth object 523 and an intermediate 

4 textured object 524. Figure 5g is intended to represent various color hue possibilities 

5 supported for objects in this invention. An object with color hue is represented 525 next 

6 to a value hue object 526 and a saturation hue object 527 for relative comparison. 

7 Naturally, in the actual display of this invention colors are used rather than simply the 

8 representation of color shown in figure 5g. Figure 5h shows the atmospheric density of 

9 the representation space possible in the display of objects in this invention. An empty- 

10 clear space 528, a full-dark space 530 and an intermediate foggy space 523 are shown 

11 with 3-D objects shown within the representative space 529, 531, 533. 

12 Aural properties supported in this invention include, but are not limited to pitch, 

13 timbre, tone and the like. 

14 Figure 6 shows the 3-D configuration of the objects in H-space in the preferred 

15 embodiment of the invention. In this view the local level, H-space 601 is shown within 

16 which the 3-D objects 602, 603, and 604 are located. Object 602 represents the 

17 respiratory function of an individual. Its 602 x-y-z dimensions change based on the 

18 parameter-based dimensional correlation. The object 603 represents the efficiency of the 

19 cardiac system by varying the x,y,z coordinates of the object. The object 604 represents a 

20 human brain function, also with the x,y,z dimensions changing based on the parameter- 

21 based dimensional correlation. In this way the user can easily view the relative 

22 relationships between the three physiological objects 602, 603, 604. Within H-space 601, 

23 the temporal coordinate (i.e., periodic time interval for data capturing that defines how H- 
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1 space is plotted in Live-space - see figure 7) is a spatial dimension on which data is 

2 mapped. The x-dimension of 605 of the H-space 601 can be mapped to another 

3 independent variable such as heart rate period, blood pressure or the like. The location of 

4 an object in the y-dimension 606 of H-space 601 can be mapped to additional variables 

5 that are desired to be monitored such as Sa02 content, Ca02 content, or temperature in 

6 the blood. The location of an object in the z-dimension 607 of the H-space 601 can also 

7 be mapped to additional variables that the user desires to monitor. A hypothetical object 

8 608 shows that the three coordinates are contextual to a particular object 608 and need 

9 not be the same for all objects, except in the object's 608 extension measuring properties. 

10 Fixed X- and z-dimension values 609a and 609b are shown as constant. The y-value 610 

1 1 of this object 608 changes to fluctuating values or data type that results in the height of 

12 the object 608 increasing or decreasing. This view shows another object 61 1 showing the 

13 relationship between the three dimensions. Constant x- and y-values 612a and 612b are 

14 shown. The z-value 613 of this object 611 changes to fluctuating values or data types 

15 that result in the width of the object 611 increasing or decreasing. An overlapping view 

16 614 of an object 615 that has extended past the H-space limitation. A limit of H-space 

17 616 with a spherical object 617 located inside H-space 616 shown with the degree of 

18 extension shown in shaded circles. 

19 Figure 7 shows a series of H-spaces 701, 702, 703, 704, 705, 706 along a global 

20 time coordinate 708, and the local-space coordinates 707 that governs each H-space. 

21 Each of these H-spaces represents progressive states of the dynamic system at pre- 

22 established temporal intervals (To, T.i, T.2, . . . T_n) and the six 701, 702, 703, 704, 705, 

23 706 together show the evolution of that system over time, demonstrating the historical 
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1 representation of individual H-states within an overall "Life-space" or "L-space." At the 

2 global level (or L-space), one of the coordinates, typically x, is always time. The 

3 temporal coordinate is scaled based on the intervals at which a particular functions 

4 system's physiologic data are collected by the art or as appropriate. This interval or 

5 module is fixed and constant across L-space and provides the necessary temporal frame 

6 of reference for comparing different H-spaces. The fixed temporal interval also 

7 determines the maximum x-extension of the representation envelope of H-space, The 

8 other two coordinates, y and z, provide L-space with extension and are not fixed. The 

9 three coordinates thus described provide a regulating 3-D environment within which the 

10 H-states can be visualized and related to each other. 

1 1 Figures 8 a and 8b show the global level coordinate system of the preferred 

12 embodiment of this invention. Figure Ba shows the L-space coordinate system 801 in its 

13 preferred embodiment. The x-dimension 802 of L-space is mapped to a constant time 

14 interval, set by means standard in the art or otherwise as appropriate. The present 

15 position of H-state is also indicated on the x-dimension 802. The y-dimension 803 in 

16 both positive and negative extensions is measured, up and down from the x-axis. This 

17 dimension 803 can be mapped to a data variable within particular 3D object in space. 

18 The z-dimension 804 is shown in both positive and negative extensions measured 

19 forwards and backwards from the intersecting x-axis. This dimension 804 can be mapped 

20 to a data variable within a particular 3D object in space. Now for figure 8b a prismatic 

21 object 800 represents a critical function, whose evolution is being monitored in L-space, 

22 of a given dynamic system. The front view 805 shows the different H-states of the 

23 prism/function 800 using a time T to T-n historical trend. The level of intersection and 
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1 separation between the front views of the prism indicate abnormal health states of the 

2 critical function the object 800 represents. No separation or intersection shows normal 

3 function conditions. The trajectory in the y-dimension of the prism (i.e., H-states of the 

4 critical function) are mapped to a variable that cause their relative position to change in 

5 the + and -y dimension. The current state 806 of the prism is shown in this front view 

6 805. A top view of 809 of the three-dimensional L-space is shown, showing the 

7 evolution of the prism 800 backward in time and showing a T to T-N historical trend. 

8 The level of intersection and separation indicate abnormal health states of the particular 

9 critical function the prism represents. No separation or intersection shows normal 

10 conditions. The trajectory in the z-dimension of the object is mapped to a variable that 

1 1 causes their position to change in the + and -z dimension. This top view shows both the 

12 z and y trajectories in one comprehensive view. The perspective view 808 of L-space 

13 gives a comprehensive view of the interaction of the prisms (the H-states of the function) 

14 and their movement in all dimensions. The side view 807 of L-space shows the prisms 

15 and their positions in L-space giving a simultaneous view of z and y trajectories. 

16 Figures 9a and 9b shows various viewpoints in which the data may be visualized 

17 in the preferred embodiment of this invention. This figure shows representations of a 

18 data object (a prism) and is provided to show that there are two basic types of viewports: 

19 orthographic and perspectival. The orthographic viewports 906, 907, 908, of figure 9b 

20 use a parallel system of projection to generate representations of H-space that maintains 

21 dimensional constancy without deformation. Some examples of orthographic views 

22 include traditional architectural or engineering views of objects, such as a top view, a 

23 front view, and a side view. The orthographic viewport allows for accurate and focused 



29 



1 2-D expressions of the actual 3-D object. The perspectival viewport 909, shown in figure 

2 9b uses a focal system of projection to generate depictions analogous to our perception of 

3 reality but at the cost of deformation and lack of dimensional constancy. For example, 

4 the top view 902 along with the side view 903 and the front view of 904 of the 3-D data 

5 object 901 are shown in figure 9a. Figure 9b shows three orthogonal views 906, 907, 908 

6 along with a perspective view 909 of the current data object. The number and types of 

7 viewports used in a particular embodiment of the invention may range from one type, for 

8 example a perspective viewport allowing immerse virtual reality, to combinations of both 

9 types. In the preferred current embodiment, there are the four viewports shown in figure 

10 9b. Given the 3-D nature of data objects and H-space, viewports provide the user with 

1 1 different depictions of the same data, 

12 Figure 10 shows the transform of an object in space in context, with a reference 

13 framework, in the preferred embodiment of this invention. The referential framework 

14 1010 is typically set based on population normals or patient normals. This framework 

15 assists the user to see deviations from normal very quickly. An individual spherical 

16 object 1011 that represents cardiac function is shown located in L-space and in relation to 

17 the referential framework. A side view 1012 is shown along with several cardiac objects. 

18 In this view the referential framework provides a center target point so that a user can 

19 make the necessary corrections to bring the object back to the ideal center of the 

20 framework. A perspectival view 1013 of the framework is also shown along with several 

21 cardiac objects. The top view 1014 of the framework is shown with several spherical 

22 objects (representing cardiac states). This figure demonstrates the variety of viewports 
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1 provided to the user by this invention, which provides enhanced flexibility of analysis of 

2 the displayed data. 

3 Figure 11a shows the zooming out function in the invention. This invention 

4 provides a variety of data display functions. This figure shows the way views may be 

5 zoomed in and out providing the relative expansion or compression of the time 

6 coordinate. Zooming out 1 101 permits the user to look at the evolution of the system's 

7 health as it implies the relative diminution of H-states and the expansion of L-space. This 

8 view 1 101 shows a zoomed out view of the front view showing a historical view of many 

9 health states. A side view 1 102 zoomed out view is provided to show the historical trend 

10 stacking up behind the current view. A 3-D perspectival, zoomed out view 1 103 showing 

1 1 the interaction of H-states over a significant amount of time is provided. A zoomed out 

12 top view 1 104 shows the interaction of H-states over a large amount of time. 

13 Figure lib shows the zooming in function of the invention. The zooming in front 

14 view 1 105 is shown providing an example of how zooming in permits a user to focus in 

15 on one or a few H-states to closely study specific data to determine with precision to the 

16 forces acting on a particular H-state. A zoomed in side view 1 106 is provided showing 

17 the details of specific variables and their interactions. A zoomed in 3-D perspective view 

18 1 107 of a few objects is also shown. Also shown is a zoomed in top view 1 108 showing 

19 the details of specific variables and their interaction, 

20 Figures 12a shows a 3-D referential framework of normative values that is 

21 provided to permit the user a direct comparison between existing and normative health 

22 states, thereby allowing rapid detection of abnormal states. The reference framework 

23 1201 works at both the global L-space level and the local H-space level. "Normal" 
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1 values are established based on average historical behavior of a wide population of 

2 systems similar to the one whose health is being monitored. This normal value 

3 constitutes the initial or by-default ideal value, which, if necessary may be adjusted to 

4 acknowledge the particular characteristics of a specific system or to follow user- 

5 determined specifications. The highest normal value of vital sign "A" 1202 (+y) is 

6 shown, along with the lowest normal value of "B" 1203 (-z), the lowest normal value of 

7 vital sign "A" 1204 (-y) and the highest normal value of vital sign "B" 1205 (+z). In 

8 figure 12b, abnormal values of "A" and "B" are shown in an orthogonal view. An 

9 abnormally high value of "A" 1206, an abnormally low value of "B'' 1207, an abnormally 

10 low value of "A" 1208 and an abnormally high value of "B" 1209 are shown. 

1 1 Figure 13 shows a comparison of the interface modes of the preferred 

12 embodiment of this invention. This invention provides two basic types of interface 

13 modes: (a) standardized or constrained customization; and (b) free or total customization. 

14 Each is directed toward different types of applications. The standardized or constrained 

15 customization 1301 uses a method and apparatus for user interface that is set a-priori by 

16 the designer and allows little customization. This interface mode establishes a stable, 

17 common, and standard symbolic system and displaying method that is "user-resistant". 

18 The fundamental rules, parameters, structure, time intervals, and overall design of L- 

19 space and H-space are not customizable. Such a normalized symbolic organization 

20 creates a common interpretative ground upon which different users may arrive at similar 

21 conclusions when provided common or similar health conditions. This is provided 

22 because similar data flows will generate similar visualization patterns within a 

23 standardized symbolic system. This interface method is intended for social disciplines, 
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1 such as medicine in which common and agreeable interpretations of the data are highly 

2 sought after to ensure appropriate and verifiable monitoring, diagnosis and treatment of 

3 health states. The customization permitted in this mode is minimal and is never 

4 threatening to render the monitoring device incomprehensible to other users. 

5 The free or total customization interface mode 1302 provides a symbolic system 

6 and displaying method that is changeable according to the user's individual needs and 

7 interests. Although the invention comes with a default symbolic L-space and H-space, its 

8 rules, parameters, structure, time intervals, and overall design are customizable. This 

9 interface mode also permits the user to select what information the user wishes to view as 

10 well as how the user wishes to display it. This interface mode may produce personalized 

1 1 displays that are incomprehensible to other users, but provides flexibility that is highly 

12 desired in individual or competitive pursuits that do not require agreeable or verifiable 

13 interpretations. Examples of appropriate applications may include the stock market and 

14 corporate health data monitoring. 

15 Figure 14 is a hardware system flow diagram showing various hardware 

16 components of the preferred embodiments of the invention in a "natural system" medical 

17 application. Initially a decision 1401 is made as to the option of using data monitored on 

18 a "real" system, that is a real patient, or data from the simulator, for anesthesiology 

19 training purposes. If the data is from a real patient, then the patient 1402 is provided with 

20 patient sensors 1404, which are used to collect physiological data. Various types of 

21 sensors, including but not limited to non-invasive BP sensors, ECG leads, Sa02 sensors 

22 and the like may be used. Digital sensors 1416 may also provide physiological data. An 

23 A/D converter 1405, is provided in the interface box, which receives the analog sensor 
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1 signals and outputs digital data to a traditional patient monitor 1406. If the data is 

2 produced 1401 by the simulator 1403, a control box and mannequins are used. The 

3 control box controls the scenarios simulated and the setup values of each physiological 

4 variable. The mannequins generate the physiological data that simulates real patient data 

5 and doctors collect the data through different, but comparable sensors. The traditional 

6 patient monitor 1406 displays the physiological data from the interface box on the screen. 

7 Typically and preferably, this monitor 1406 is the monitor used generally in an ICU. A 

8 test 1407 is made to determine the option of where the computations and user interface 

9 are made, that is whether they are made on the network server 1408 or otherwise. If a 

10 network server 1408 is used, all or part of the data collection and computation may be 

1 1 performed on this computer server 1408. An option 1409 is proved for running a real 

12 time representation versus a representation delayed or replayed from events that 

13 previously occurred. For real time operation, a data buffer 1410 is provided to cache the 

14 data so that the representation is played in real time. For the replay of previous events, a 

15 data file 1411 provides the means for permanently storing the data so that visualization is 

16 replayed. The visualization software 1412 runs on a personal computer and can display 

17 on its monitor or on remote displays via the internet or other networking mechanism. 

18 Typically the physiological data measured on either a real patient or the simulator are fed 

19 to the personal computer from the traditional data monitor. A standard interface such as 

20 RS232, the internet, or via a server, which receives data from the monitor, may serve as 

21 the communication channel to the personal computer running the visualization software 

22 1412. This program 1412 is the heart of the invention. The program 1412 computes the 

23 representation and processes the user interface. An option 1413 is provided for 
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1 computing and user interface on the local desktop personal computer or for distribution 

2 across the internet or other network mechanism. If a local desktop personal computer is 

3 selected, the personal computer 1414 with an adequate display for computation of the 

4 visualization and user interface is provided. If a remote user interface 1415 is selected 

5 the display and user interface is communicated across the internet. 

6 Figure 15 is a software flow chart showing the logic steps of a preferred 

7 embodiment of the invention. The preferred embodiment of this invention begins by 

8 reading the startup file 1501, which contains the name of the window and the properties 

9 associated with the invention. The properties associated with the a window include 

10 formulas to set object properties, text that is to be rendered in the scene, the initial size of 

1 1 the window, the initial rotation in each window, zoom, lighting and patient data that 

12 describes the normal state of each variable. Internal data tables are next initialized 1502. 

13 For each new window encountered in the startup file a new window object is made and 

14 this window object is appended to the list of windows. The window object contains an 

15 uninitialized list of properties describing the state of the window, which is filled with data 

16 from the startup file. The event loop is entered 1503. This is a window system 

17 dependent infinite loop from which the program does not exit. After some initialization, 

1 8 the program waits for user input and then acts on this input. The program then takes 

19 control of the event loop for continuous rendering that is if there is no interactivity in the 

20 program. Mtialization 1504 of windows is next performed. This involves calls to the 

21 window system dependent functions (these are functions that are usually different on 

22 different computational platforms) that creates the windows and displays them on the 

23 computer screen. In the current preferred embodiment of the invention, OpenGL is 
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1 required, although alternative embodiments using other 3D application programming 

2 interfaces, such as PEX or DirectX, could be substituted without departing from the 

3 concept of this invention. Also, in the preferred embodiment of this invention, a personal 

4 computer graphics card is preferred in the personal computer so as to permit smooth 

5 animation with multiple windows. Although the lack of such a card is not absolutely 

6 required for operation of this invention. New data is received 1 509, typically from the 

7 data file 1 506 or the data buffer 1 507. This new data 1509 can come from any source 

8 that generates floating-point numbers. The preferred line of data is composed of columns 

9 of floating point numbers separated by space. At this point the current time is also stored 

10 so that the next line of data can be obtained at the next user defined time interval, which 

1 1 is typically set at about 1 second. Object properties are next computed 1510. This is 

12 performed by using formulas that are specified in the startup file to compute properties of 

13 objects. Data fields in the formulas are specified by writing the column number preceded 

14 by a dollar sign. For example, $ 1 / 20.0 would divide the first field by 20.0. The specific 

15 properties in this application are: cardiac object dimensions, material properties, and 

16 position. Material properties can include the red, green, and blue components as they 

17 appear under ambient, diffuse, and specular light, as well as transparency. The cardiac 

18 object position includes the y and z positions as well as an x shift. If four or more lines 

19 of data have been acquired, the respiratory object properties are computed. A delay is 

20 necessary because a cubic spline is fitted, using four data points to do the fit, to the data 

21 points to generate a smooth respiratory object. Therefore, until four time steps have 

22 passed, the curtain is not rendered. Thereafter, it is rendered every time new data is 

23 acquired. Cardiac object properties include material properties and the height of the color 
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1 bands. Blood pressure object length and materials are the thin cylinders that go through 

2 the top and bottom of each ellipsoid. Next, reference grid properties are computed. All 

3 objects, except the cardiac object reference are stationary, in the current implementation. 

4 The cardiac object reference can move according to the movement of the cardiac object if 

5 the user specifies this movement in the startup file. Next, sounds are computed 1511 and 

6 made audible 1513. Objects and reference grids are rendered 1512. Before rotation the 

7 newest object appears at the right side of the screen and oldest object is at the left side of 

8 the screen. Sound is produced 1513 next. A test 1514 is next made to determine if 

9 smooth animation is selected. If smooth animation is selected the scene will scroll during 

10 the time the program is waiting to get new data. The program, using available computing 

1 1 resources, selects the minimum time increment so that the shift of the objects can be 

12 rendered within the increment, but limiting the increment to the smallest increment that 

13 human eyes can detect. If smooth animation is not selected, objects are shifted to the left 

14 1515 such that the distance from the center of the newest cardiac object to that of the 

15 former cardiac object is equal to the inter-cardiac spacing. The process waits 1508 until 

16 the current time minus the time since data was last obtained equals the data acquisition 

17 period specified by the user. If the current time minus the time when the data was last 

18 acquired equals the user specified data acquisition period then a new line of data is 

19 acquired. If smooth animation is selected, then the cardiac objects are shifted to the left 

20 by computing 1 5 1 6 to that when it is time to get the next line of data, the cardiac objects 

21 have moved 1517,1518 such that the distance from the rightmost cardiac object to the 

22 position where the new cardiac object will appear is equal to the inter-cardiac-object 

23 distance. For example, if it takes 0.20 seconds to render the previous scene, the period of 
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1 data acquisition is 1 .0 seconds, and the x shift of the rightmost cardiac object is 0. 1 units 

2 then the program will shift the scene left (0.20 / (1.0 + 0.20) * (1-0 - 0.1) = 0.15. The 

3 formula in the denominator is (1 .0 + 0.20 instead of 0.8 because, if the scene has been 

4 shifted left such that, when new data is acquired, the shifting has stopped (because the 

5 position of the cardiac objects satisfies the criteria that the distance from the center of the 

6 rightmost cardiac object to the center point where the new cardiac object will be rendered 

7 = 1 unit) then the animation will no longer be smooth, that is, when new data is acquired 

8 the animation will appear to stop. Note, that the respiratory object is never entirely 

9 smoothly shifted because no data is available to render the object at the intermediate time 

10 steps. 

1 1 Figure 16 is a software block diagram showing the logic steps of the image 

12 computation and rendering process of a preferred embodiment of the invention. This 

13 process begins with acquiring the window identification 1601 of the current rendering 

14 context. Next, the data structure is found 1602 corresponding to the current window 

15 identification. After which, the view is set 1603. A rotation matrix is set 1604. A 

16 projection matrix is set 1605. Lights are set 1606. The back buffer is cleared 1607. 

17 Object processing 1608 begins, and includes for each cardiac object, calling OpenGL to 

18 see material properties; shift left one inter-cardiac-object distance; push the modelview 

19 matrix, shift x,y, and z directions; call OpenGL utility toolkit to render the cardiac object; 

20 set the top cardiac object material properties, call OpenGL quadries function to render top 

21 cardiac object; set top cardiac object material properties, call OpenGL quadries function 

22 to render bottom cardiac object and pop modelview matrix. Next, the view is set 1609, as 

23 above. The respiratory object is rendered 1 610, by setting OpenGL to render quad strips, 
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1 for each polygon strip set material properties, and send vertex to OpenGL. Reference 

2 grids are rendered 1611 by setting material property of the cardiac reference grid. The 

3 current position is set 16 12 to be the ideal position of the newest cardiac object, that is the 

4 position corresponding to a patient in ideal health. The cardiac object material properties 

5 are set 1613. The OpenGL utility toolkit is called to render 1614 the cardiac object. 

6 Next, OpenGL is set to render quads 1615. After which the material properties of the 

7 reference planes are set 1 6 1 6. Vertices that compose the reference planes through the 

8 OpenGL pipeline are sent 1617 and buffers are swapped 1618. Buffer swap is a window 

9 system defendant function. 

10 Figure 17 is a photograph of the 3-dimensional display of a preferred embodiment 

1 1 of the invention. The 3-D view shown at lower right 1706 provides a comprehensive, 

12 integrated and interactive view of all physiological data, and shows the interaction 

13 between the different objects in relation to the reference frame. This view can be 

14 manipulated by the user to fit specific application needs. The front 1701, side 1704, 1705 

15 and top views 1702 show how the same data appears from different vantage points. In 

16 this figure these views 1701, 1702, 1704, 1705 show the interaction between the cardiac 

17 object, the reference frame and the respiratory object, with the side view 1704 providing 

1 8 a target for optimum efficiency of the cardiac system 1705 shows the level of gas 

19 concentration in the lungs and overall tidal volume in the respiratory system. This figure 

20 17 is a representation of a true 3-D model of the physiologic data. The circle 1703 

21 shown is the top view of the respiratory waveform showing C02 content in the lungs and 

22 inspiration and expiration values. In 1703, a real time display, the object grows and 

23 shrinks with each heartbeat. Its height is proportional to the heart's volume output and its 
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1 width is proportional to heart rate. The gridframe (or reference framework) shows the 

2 expected normal values for stroke volume and heart rate. The position of this object in 

3 the vertical direction of the display is proportional to the patient' s mean blood pressure. 

4 This graphic objects shape and animation provides a useful graphical similarity to a 

5 working heart. In the preferred embodiment, the background is colored to show inspired 

6 and expired gases. The height of the "curtain" is proportional to tidal volume, while the 

7 width is proportional to respiratory rate. The colors, which are, displayed in the preferred 

8 display show the concentrations of respiratory gases. Time is set to move from right to 

9 left, with the present or current conditions shown at the "front" or right edge of each 

10 view. Past states remain to provide a historical view of the data. 

1 1 Figure 1 8 is a close-up front view of the cardiac object and the associated 

12 reference framework of a preferred embodiment of the invention. The upper limit of 

13 normal blood pressure value is shown 1800 on the reference frame. The systolic blood 

14 pressure level is indicated by the bar 1801 penetrating the cardiac sphere 1806. The 

15 height 1 802 of the sphere 1 806 is proportional to cardiac output, which shows the 

16 optimum efficiency of the heart. The width of the sphere 1806 is proportional to 1/heart 

17 rate. The elevation of the sphere 1 806 is an indication of mean blood pressure, where the 

18 center reference gridline is a normal mean blood pressure 1803. The lower limit, or 

19 diastolic blood pressure 1 804 is shown by the length of the bar extending downward from 

20 the sphere 1 806. Previous historical values for the sphere 1806 are also provided in 

21 1805, 1807. 

22 Figure 19 is a view of the front view portion of the display of a preferred 

23 embodiment of the present invention showing the cardiac object in the foreground and 
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1 the respiratory object in the background. This view 1900 provides a more quantitative 

2 image of the hemodynamic variables, stroke volume, blood pressure 1 901 and heart rate. 

3 The "normal" reference lines are more apparent. In the preferred embodiment, 

4 respiration is shown by changes in the background color. 

5 Figure 20 is a view of the top view portion of the display 2000 of a preferred 

6 embodiment of the present invention showing the cardiac object toward the bottom of the 

7 view and the respiratory object toward the top of the view. Inhaled gas 2002 and exhaled 

8 gas 2003. C02 concentrations and oxygen saturation of the arterial blood 2001 versus 

9 time are also shown. 

10 Figure 21 is a view of the side view portion of the display of a preferred 

1 1 embodiment of the present invention showing the cardiac object to the left and the 

12 respiratory object to the right. Gas concentration in the lungs 2101, a calibrated scale for 

13 gas concentration 2103, blood pressure 2100, and oxygen saturation 2101 are shown. 

14 The end view, shown here in figure 2 1 , is especially useful during treatment, where the 

15 goal is to bring the variables back to the center or normal state. Functional relationships 

16 can be added to this view to predict how treatment can be expected to bring the variables 

17 back to normal. 

18 Figure 22 is a view of the 3-D perspective view portion of the display of a 

19 preferred embodiment of the present invention showing the cardiac object in the left 

20 foreground and the respiratory object in the right background. This view 2200 provides 

21 a comprehensive, integrated and interactive view of nine physiological variables. The 

22 sphere 2201 grows and shrinks with each heartbeat. Its height is proportional to the 

23 heart' s stroke volume and its width is proportional to heart rate. This graphic object 220 1 
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1 offers useful similarity to a beating heart. The gridframe 2202 shows the expected 

2 normal values for stroke volume and heart rate. The position of this object 2201 on the 

3 screen is proportional to the patient's mean blood pressure. The ends of the bar 2203 

4 drawn vertically through the center of the heart object show systolic and diastolic blood 

5 pressure, hi the preferred embodiment of the invention, the background 2204 is colored 

6 to show inspired and expired gases. The height of the "curtain" 2205 is proportional to 

7 tidal volume. The width of each fold 2206 is proportional to respiratory rate. In the 

8 preferred embodiment colors are used to show the concentrations of respiratory gases. 

9 Time moves from right to left with the present condition shown at the "front" or right 

10 edge of the view 2200. Past states 2207 remain to permit a historical view of the data. 

1 1 Figure 23 is a view of an example of the preferred display 2300 of the drug effects 

12 shown in this invention. Concentration is shown by the plots 2301 a,b,c. The 

13 concentration is also presented with respect to the classification of the anesthetic, 

14 sedatives 2302, analgesic 2303, and muscle relaxants 2304. In the preferred embodiment 

15 each drug is color-coded. Past, current and predicted concentrations are normalized with 

16 respect to the drug's EC95 value (the drug concentration at which 95% of the population 

17 is completely affected by the anesthetic drug) and plotted relative to the time 2305 that it 

18 was administered. The current drug effects are represented as a 3-dimensional bar or pie 

19 charts 2302, 2303, 2304. The effects are presented proportionally to the extent that the 

20 objects 2302, 2303 , 2304 are filled. 

21 Figure 24 is a view of a second example of the preferred display 2400 of the drug 

22 effects shown in this invention. The plots 2401a,b,c are shown displaying effect site drug 

23 concentration. The pie chart 2402 shows the sedation effect. The bar chart 2403 shows 
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1 the analgesia effect. The bar chart 2404 shows the muscle relaxant effect. This data is 

2 plotted against time 2405. 

3 Figure 25 is a system flow process flow diagram of the preferred embodiment of 

4 this invention. A drug delivery system 2500 communicates through a data stream 2502 

5 to a drug display monitor device 2503. The patient 2504 is shown receiving anesthetic 

6 drugs 2505 from a drug delivery system 2506. The preferred drug delivery system 2506 

7 includes an infusion pump 2507, an anesthesia machine 2508 and/or a set of bar coded 

8 syringes and a bar code reader. A simulator program or process 2501 is provided for 

9 testing purposes and is designed to simulate boles (injection) drugs 25 11 , infusion drugs 

10 25 1 2, and anesthetic agents 25 1 3. The drug delivery system 2506 communicates with the 

1 1 data stream 2502 via multiple data channels 25 10. In the present preferred embodiment 

12 of the invention, the multiple data channels may include a TCP/IP socket, a serial RS-232 

13 interface, and/or a serial RS-495 USB interface. Other alternative communication 

14 channels can be substituted without departing from the concept of this invention. The 

15 preferred interface 25 14 between the simulator 2501 and the data stream 2502 is a UDP 

16 socket, although alternative communication interfaces can be substituted without 

17 departing from the concept of this invention. The data stream 2502 provides a data path 

18 25 1 5 to the drug display monitor system 2503. Included in the drug display monitor 

1 9 system is a decode data function 25 1 6 that receives the data stream 2502. A dosage or 

20 infusion rate calculator 25 17 receives the decoded data. A drug modeler/normalizer 25 1 8 

21 receives the dosage and/or infusion rate data and proceeds to store 25 19 the dosage type, 

22 dosage rate, drug concentration, drug type, the concentration effect, and the site 

23 concentration effect. The drug modeler/normalizer 25 1 8 provides the appropriate data to 
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1 a first display function 2520 for showing drug dosage or rate and drug name, to a second 

2 display function 252 1 for showing past, present, and predicted site concentration effects, 

3 and to a third display effect computer function 2522. 

4 Figure 26 is a preferred hardware/communication diagram of the preferred 

5 embodiment of this invention. A central processing unit (CPU or processor) 2601 is 

6 provided to execute the process of this invention, specifically to produce the internal 

7 representation of the drug display, to decode the data stream, and to compute the 

8 interaction between drug models. The processor 2601 communicates with the data 

9 stream 2502 via a communication channel 2602. The communication channel 2602 can 

10 be a serial, parallel or socket type channel. The processor 2601 is electrically connected 

11 to volatile memory 2603 for the dynamic storage of variables. The processor 2601 is also 

12 electrically connected to a static memory device (such as static RAM, disk drives or the 

13 like) 2604 for the storage of drug delivery data and trends. A user interface 2607 is 

14 connected to the processor 260 1 to enable user interaction. The typical user interface 

15 2607 is a keyboard, mouse, touchscreen or the like. A graphics adapter 2608 is in 

16 communication with the processor 2601 for preparing data for rendering on a standard 

17 display 2609. The typical standard display 2609 is a monitor, an LCD device or the like. 

18 A hardcopy printer 2605 and a data dump visualization device 2606 is also provided, 

19 typically in communication with the processor 2601 through the memory 2604. 

20 Figure 27 is a top-level flow chart of the preferred drug monitoring process of this 

21 invention. Initially, the system is powered up 2701. Variables are initialized 2702. 

22 Additional detail on the variable initialization 2702 is provided in figure 28. Polling 

23 2703 for data collection is performed 2703 . A test 2704 is made to determine if a 
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1 connection has been detected. If no connection is detected the process returns to the 

2 polling 2703 for data connection. If a connection is detected, a test 2705 is made to 

3 determine if a UDP socket connection exists. If no UDP socket connection exists, then a 

4 test 2706 is made to determine if a file connection has been made. If no file connection 

5 has been made, polling 2703 for data connection continues, ff a file connection has been 

6 made, then a demo mode is run 2707. Additional detail on the demo mode is described 

7 with respect to figure 30. If a UDP socket connection exists, then the socket header is 

8 decoded 2708. A test 2709 is then made to determine if the socket has been initialized. 

9 If the socket has not been initialized, the process continues polling 2703 for data 

10 connection. If the socket has been initialized 2709, then initialization data is stored 2710. 

1 1 This initialization data includes, but may not be limited to, patient height, weight, gender, 

12 age, model iteration time or update rate and the like. After storing 2710 the data, the drug 

13 display function is run 271 1 or executed. Additional detail on the run drug display step 

14 27 1 1 is provided below with respect to figure 29. 

15 Figure 28 is a detailed flow chart of the initialize variables section 2702 of the 

16 preferred drug monitoring process of this invention. Initially, the number of drugs is set 

17 2901 to zero. The drug object pointer array is initialized 2802 to NULL. The scene 

18 rendered flag is set 2803 to false. The user window is setup 2804 for OpenGL. Next, a 

19 sedative plot, analgesia plot and a neuro-muscular block plot is created 2805. A test 2806 

20 is then made to determine if the processes is idle, if so the IdleLoop service routine is 

21 called. Additional detail on the IdleLoop service routine is discussed below and shown in 

22 figure 31. 
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1 Figure 29 is a detailed flow chart of the run drug display section 27 11 of the 

2 preferred drug monitoring process of this invention. First, a timer is started 2901 . This 

3 enables the timer interrupt routine to be called at intervals of "update time." Additional 

4 detail on the timer interrupt is provided below in association with figure 37. Next, the 

5 data source is polled 2902. A test 2903 is made to determine if a data packet header byte 

6 has been found. If not, the polling 2902 continues. If a data packet header byte is found, 

7 the data packet is decoded 2904 and the scene render flag is set 2905 to false. Additional 

8 detail on the data decoder step 2904 is provided below with respect to figure 35. 

9 Figure 30 is a detailed flow chart of the run demo mode section 2707 of the 

10 preferred drug monitoring process of this invention. The file is opened 3001. The first 

1 1 character ("C") is read 3002. A test 3003 is made to determine if C = If C = "*" 

12 then the file is read and assigned 3004 a sample period. Following the reading and 

13 assignment 3004 this section ends 3013. If C is not equal to "*", then a test 3005 is made 

14 to determine if C = "#". If C = "#", then a new drug record is created 3006, the new drug 

15 information is decoded 3007, and the new drug is added 3008 to the appropriate drug 

16 plot, after which this section of the process ends 301 3. If C is not equal to "#", then a test 

17 3009 is made to determine if C = "\". If C = "\", then the drug concentration is read 

18 30 1 0, the drug concentration is assigned 30 1 1 , and the concentration is added 30 1 2 to the 

19 drug queue, after which this section ends 3013. If C is not equal to "\", this section of the 

20 process ends 3013. 

21 Figure 3 1 is a detailed flow chart of the idle loop section, of figure 28 step 2806, 

22 of the preferred drug monitoring process of this invention. First, I is set 3101 to zero. A 

23 test 3 102 is made to determine if I is less than the number of drugs. If I is not less than 
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1 the number of drugs, then a test 3 103 is made to determine if the scene has been 

2 rendered. If the scene has been rendered, this section of the process ends 3105, If the 

3 scene has not been rendered, then the scene is rendered 3104. Additional detail on the 

4 scene-rendering step 3 104, is discussed below, with respect to figure 32. If I is less than 

5 the number of drugs, then the drug value I is iterated 3 106 for the predictive model. 

6 Additional detail on the predictive model 3106 process is discussed below with respect to 

7 figure 33. After the predictive model is iterated 3106, 1 is incremented 3107 by one, and 

8 the process returns to the test 3 102. 

9 Figure 32 is a detailed flow chart of the render the scene section 3 104 of the 

10 preferred drug monitoring process of this invention. First, chart titles are drawn 3201. 

1 1 Next, the sedation plot is drawn 3202. The analgesia plot is then drawn 3203. After 

12 which the neuro muscular block plot is drawn 3204. Additional detail on the plotting 

13 32012, 3203, 3204 is discussed below with respect to figure 36. The OpenGL buffers 

14 are finally swapped 3206, after which this section of the process ends 3206. 

15 Figure 33 is a detailed flow chart of the iterate drug model section 3106 of the 

16 preferred drug monitoring process of this invention. First the reference to the specific 

17 PKModel of the drug is captured 3301. Next, the PkModel is iterated 3302. The 

18 preferred PkModel interaction uses an algorithm described in Shafer and Greg, 

19 Algorithms to Rapidly Achieve and Maintain Stable Drug Concentrations at the Site of 

20 Drug Effect with a Computer Controlled Infusion Pump , Journal of Pharmokenetics and 

21 Biopharmaceutics, vol. 20, #2, 1992. After iteration of the PkModel, the resulting 

22 concentration is added 3303 to the drug's circular queue of data, thereby including either 

23 past, present or predicted circular queues. Then this section of process ends 3304. 
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1 Figure 34 is a detailed flow chart of shift data left section of the preferred drug 

2 monitoring process of this invention. Initially, a test 3401 is made to determine if the 

3 drug queue is full. If the drug queue is full, then an item is removed 3402 from the front 

4 of the queue. Then a test 3403 is made to determine if the drug queue of predicted 

5 concentrations exists. If the predicted queue doesn't exist, then this section of the 

6 process ends 3407. If the predicted queue exists, then a test 3404 is made to determine if 

7 the queue is not empty. If the queue is empty, then this section of the process ends 3407. 

8 If the queue is not empty, then an item is removed 3405 from the front of the queue. The 

9 GL data current is set 3406 to false and this section of the process ends 3407. 

10 Figure 35 is a detailed flow chart of the decode data packet section 2904 of the 

11 preferred drug monitoring process of this invention. The data is received 3501 from a 

12 socket. A test 3502 is made to determine if it is a header packet. If it is a header packet, 

13 then a test 3503 is made to determine if the packet length header is okay. If the packet 

14 length header is not okay, then the process of this section ends 35 19. If the packet length 

15 header is okay, then the sample period is decoded 3504, the weight is decoded 3504, the 

16 height is decoded, and the gender is decoded 3506, after which this section of the process 

17 ends 3519. If it is not a header packet, then a test 3507 is made to determine if it is a 
IS message packet. If it is a message packet, then the message is decoded 3508 and the 

19 message is logged 3509 to a file. If it is not a message packet, then a test 3510 is made to 

20 determine if it is a data packet. If it is not a data packet, then this section of the process 

21 ends 3519. If it is a data packet, then drug data is decoded 3511. A test 3512 is made to 

22 determine if this is a new drug. If it is a new drug, a new drug record is created 3513, and 

23 the drug is added 3514 to the appropriate plot and the process continues to the decoding 
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1 3515 of the drug volume. If it is not a new drug, the drug volume is decoded 3515. Next, 

2 the drug concentration is decoded 3516, the infusion rate is decoded 3517 and the future 

3 concentration is predicted 3518, after which this section of the process ends 3519. 

4 Figure 36 is a detailed flow chart of the draw plot sections 3202, 3203, 3204 of 

5 the preferred drug monitoring process of this invention. Initially, a shaded gradient is 

6 drawn 3601. The axes are drawn 3602. The EC95 wire is drawn 3603. Ticks are drawn 

7 3604. Plot labels are drawn 3605. Drug labels are drawn 3606. Effect data is retrieved 

8 3607, including concentration and dosage data for each drug in the plot. Dosages are 

9 drawn 3608. Concentric curves are drawn 3609. Effect data is retrieved 3610, as a 

10 percentage of effect. Effect object outlines are drawn 361 1. Filled effect objects are 

1 1 drawn 3612, proportionally to the drug effect. The Object label effects are drawn 3613. 

12 Figure 37 is a detailed flow chart of the timer interrupt routine section, see figure 

13 29 step 2901, of the preferred drug monitoring process of this invention. A test 3701 is 

14 made to determine if the data is from a file. If it is from a file, the data is read from the 

15 file, as shown in figure 30 from step 3002 on. If the data is not from a file, a test 3703 is 

16 made to determine if the data is from a socket. If the data is not from a socket, then the 

17 scene rendered flag is set 3704 to false, and this section of the process ends 3705. If the 

18 data is from a socket, then I is set to zero. Next, a test 3707 is made to determine if I is 

19 less than the number of drugs. If I is not less than the number of drugs, then the process 

20 goes to step 3704. If I is less than the number of drugs, then the drug I is iterated 3708, 

21 as shown in figure 33, to generate the past and present concentrations. Next, the drug I is 

22 shifted left 3709, as shown in figure 34. I is incremented 3710 by one and the iteration 

23 process continues with test 3707. 
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1 It is to be understood that the above-described embodiments and examples are 

2 merely illustrative of numerous and varied other embodiments and applications which 

3 may constitute applications of the principles of the invention. These above-described 

4 embodiments are provided to teach the present best mode of the invention only, and 

5 should not be interpreted to limit the scope of the claims. Such other embodiments, may 

6 use somewhat different steps and routines which may be readily devised by those skilled 

7 in the art without departing from the spirit or scope of this invention and it is our intent 

8 that they are deemed to be within the scope of this invention. 
9 
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1 CLAIMS 

2 We^laim: 

3 1/ A method for data representation, comprising: 

4 (A) initializing variables; 

5 (B) polling for data connection; 

6 (C) decoding a header connected and polled; 

7 (D) storing initialization data; and 

8 (E) running a drug display routine. 

9 2. A method for data representation, as recited in claim 1 , wherein said initializing 

10 variables further comprises: 

11 ( 1 ) setting the number of drugs to zero; 

12 (2) initializing drug object pointer array; 

13 (3) setting scene render flag to false; 

14 (4) setting up the user window; 

15 (5) creating plots; and 

16 (6) calling a service routine if the process is idle. 

17 3. A method for data representation, as recited in claim 1 , wherein said run drug 

1 8 display step further comprises : 

19 ( 1 ) starting a timer; 

20 (2) polling from a data source; 

21 (3) decoding a data packet; and 

22 (4) setting a scene render flag to false. 
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1 4. A method for data representation, as recited in claim 2, wherein said decoding a 

2 data packet further comprises : 

3 (a) testing for a header packet; 

4 (b) testing for a message packet; 

5 (c) testing for a data packet; 

6 (d) decoding drug data if a data packet; 

7 (e) testing if a new drug; 

8 (f) creating a new drug record, if a new drug; and 

9 (g) decoding drug data; and predicting future of drug 
IQ concentrations. 

11 5. A method for data representation, as recited in claim 4, wherein said decoding 

12 drug data further comprises, decoding drug concentration and decoding drug infusion 

13 rate, 

14 ft A system for data representation, comprising: 

15 (A) a drug delivery system; 

16 (B) a data stream device, in communication with said drug delivery system; 

17 and 

1 g (C) a drug display monitor, in communication with a data stream device. 

19 7. A system for data representation, as recited in claim 6, wherein said drug delivery 

20 system further comprises: 

21 (1) an infusion pump; 

22 (2) an anesthetic administration machine; and 

23 (3) one or more bar coded syringes. 



52 



1 8. A system for data representation, as recited in claim 6, wherein said drug delivery 

2 system further comprises a simulator, which simulates drug administration. 

3 9. A system for data representation, as recited in claim 8, wherein said simulator 

4 simulates boles drugs. 

5 10. A system for data representation, as recited in claim 8, wherein said simulator 

6 simulates infusion drugs. 

7 11. A system for data representation, as recited in claim 8, wherein said simulator 

8 simulates anesthetic drugs. 

9 12. A system for data representation, as recited in claim 6, wherein said drug display 

10 monitor, further comprises: 

11 ( 1 ) a data decoder receiving data from said data stream device; 

12 (2) a dosage calculator receiving decoded data from said data 

13 decoder; 

14 (3) a drug modeler and normalizer receiving calculated data 

15 from said data decoder; 

16 (4) a storage device, receiving drug and dosage data from said 

17 drug modeler and normalizer; and 

18 (5) a display generator. 

19 13. A system for data representation, as recited in claim 12, wherein said display 

20 generator produces a display of drug dosage, drug name, past, present and predicted drug 

21 site concentration. 

22 ^A. A system for data representation, comprising: 
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1 (A) a processor, computing drug models, producing an internal representation 

2 of drug display data and decoding a data stream; 

3 (B) a memory unit in communication with said processor; 

4 (C) a long term memory unit in communication with said processor; 

5 (D) a graphics adapter in communication with said processor; and 

6 (E) a display monitor, in communication with said graphics adapter. 

7 
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1 ABSTRACT 

2 A method, system and apparatus for the monitoring, diagnosis and evaluation of 

3 the state of a dynamic system is disclosed. This method and system provides the 

4 processing means for receiving sensed and/or simulated data, converting such data into a 

5 displayable object format and displaying such objects in a manner such that the 

6 interrelationships between the respective variables can be correlated and identified by a 

7 user. This invention provides for the rapid cognitive grasp of the overall state of a critical 

8 function with respect to a dynamic system. The system provides for displayed objects, 

9 which change in real-time to show the changes of the functions of the system. It is a 

10 highly flexible system which works with a wide variety of applications, including 

11 biological systems, environmental systems, engineering systems, economic systems, 

12 mechanical systems, chemical systems and the Uke. In particular, this invention is 

13 directed to the processing and display of drug data for the use of doctors in the process of 

14 monitoring or administering drugs to patients. 
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